Semantics of video shots for content-based retrieval

Content-based video retrieval research combines expertise from many different areas, such as signal processing, machine learning, pattern recognition, and computer vision. As video extends into both the spatial and the temporal domain, we require techniques for the temporal decomposition of footage so that specific content can be accessed. This content may then be semantically classified - ideally in an automated process - to enable filtering, browsing, and searching. An important aspect that must be considered is that pictorial representation of information may be interpreted differently by individual users because it is less specific than its textual representation. In this thesis, we address several fundamental issues of content-based video retrieval for effective handling of digital footage. Temporal segmentation, the common first step in handling digital video, is the decomposition of video streams into smaller, semantically coherent entities. This is usually performed by detecting the transitions that separate single camera takes. While abrupt transitions - cuts - can be detected relatively well with existing techniques, effective detection of gradual transitions remains difficult. We present our approach to temporal video segmentation, proposing a novel algorithm that evaluates sets of frames using a relatively simple histogram feature. Our technique has been shown to range among the best existing shot segmentation algorithms in large-scale evaluations. The next step is semantic classification of each video segment to generate an index for content-based retrieval in video databases. Machine learning techniques can be applied effectively to classify video content. However, these techniques require manually classified examples for training before automatic classification of unseen content can be carried out. Manually classifying training examples is not trivial because of the implied ambiguity of visual content. We propose an unsupervised learning approach based on latent class modelling in which we obtain multiple judgements per video shot and model the users' response behaviour over a large collection of shots. This technique yields a more generic classification of the visual content. Moreover, it enables the quality assessment of the classification, and maximises the number of training examples by resolving disagreement. We apply this approach to data from a large-scale, collaborative annotation effort and present ways to improve the effectiveness for manual annotation of visual content by better design and specification of the process. Automatic speech recognition techniques along with semantic classification of video content can be used to implement video search using textual queries. This requires the application of text search techniques to video and the combination of different information sources. We explore several text-based query expansion techniques for speech-based video retrieval, and propose a fusion method to improve overall effectiveness. To combine both text and visual search approaches, we explore a fusion technique that combines spoken information and visual information using semantic keywords automatically assigned to the footage based on the visual content. The techniques that we propose help to facilitate effective content-based video retrieval and highlight the importance of considering different user interpretations of visual content. This allows better understanding of video content and a more holistic approach to multimedia retrieval in the future

Influence of heat pressure steaming (HPS) on the mechanical and physical properties of common oak wood.

Common oak (Quercus robur) was thermally treated applying a heat pressure steaming procedure. Physical and mechanical properties of treated and untreated samples were investigated extensively. Swelling, water absorption, water vapour resistance, porosity and thermal conductivity were tested and the mechanical properties of tensile, bending and compression strength and of Young’s modulus (static and dynamic) as well as Poisson’s ratio and shear modulus were determined. The tests were carried out in the standard climate 20 °C and 65 % relative humidity and also in all three anatomical main directions: longitudinal, radial and tangential. The equilibrium moisture content at 20 °C and 65 % relative humidity for HPS (heat pressure steamed) oak (determined in adsorption test) was 6.7 % and for untreated oak 9.1 %. Swelling in longitudinal direction was not affected: a reduction of 17 and 10 % could be observed in radial and tangential direction, respectively. The porosity of the treated samples was 53.9 % in comparison to the untreated samples with 51.0 %. The thermal conductivity depending on the modification procedure changed only slightly which was related to the different densities of the samples. The water vapour resistance of the modified samples increases compared to the untreated samples. The values are double (dry-cup) respectively three times (wet-cup) higher than those of the reference samples. The elastic properties were not influenced by heat pressure steaming. The MOE does not show a significant change depending on the treatment. Bending and tensile strength of HPS oak decrease. In longitudinal direction, the tensile strength drops by 26 % and the bending strength by 25 %.ISSN:0018-3768ISSN:1436-736

Convergence Radii for Eigenvalues of Tri--diagonal Matrices

Consider a family of infinite tri--diagonal matrices of the form $L+ zB,$ where the matrix $L$ is diagonal with entries $L_{kk}= k^2,$ and the matrix $B$ is off--diagonal, with nonzero entries $B_{k,{k+1}}=B_{{k+1},k}= k^\alpha, 0 \leq \alpha < 2.$ The spectrum of $L+ zB$ is discrete. For small $|z|$ the $n$-th eigenvalue $E_n (z), E_n (0) = n^2,$ is a well--defined analytic function. Let $R_n$ be the convergence radius of its Taylor's series about $z= 0.$ It is proved that $$ R_n \leq C(\alpha) n^{2-\alpha} \quad \text{if} 0 \leq \alpha <11/6.$

Root asymptotics of spectral polynomials for the Lame operator

The study of polynomial solutions to the classical Lam\'e equation in its algebraic form, or equivalently, of double-periodic solutions of its Weierstrass form has a long history. Such solutions appear at integer values of the spectral parameter and their respective eigenvalues serve as the ends of bands in the boundary value problem for the corresponding Schr\"odinger equation with finite gap potential given by the Weierstrass $\wp$-function on the real line. In this paper we establish several natural (and equivalent) formulas in terms of hypergeometric and elliptic type integrals for the density of the appropriately scaled asymptotic distribution of these eigenvalues when the integer-valued spectral parameter tends to infinity. We also show that this density satisfies a Heun differential equation with four singularities.Comment: final version, to appear in Commun. Math. Phys.; 13 pages, 3 figures, LaTeX2

APLICAÇÃO DE PERFIS DE VARREDURA NA ANÁLISE GEOMORFOLÓGICA DO RELEVO DE BORDA PLANÁLTICA E MAPEAMENTO DE SUPERFÍCIES ESTRUTURAIS

O presente trabalho teve como principal objetivo a aplicação de perfis de varredura para análise geomorfológica na borda planáltica entre o Segundo e Terceiro Planaltos Paranaenses. Os perfis de varredura permitem reconstituir a inclinação dos planos tangenciais às linhas de cumeada e a identificação de faixas de transição de patamares. Foram identificadas oito superfícies estruturais (SE), que são controladas e delimitadas por falhas normais e definem o Alto Estrutural de Mauá da Serra

High-level feature detection from video in TRECVid: a 5-year retrospective of achievements

Successful and effective content-based access to digital video requires fast, accurate and scalable methods to determine the video content automatically. A variety of contemporary approaches to this rely on text taken from speech within the video, or on matching one video frame against others using low-level characteristics like colour, texture, or shapes, or on determining and matching objects appearing within the video. Possibly the most important technique, however, is one which determines the presence or absence of a high-level or semantic feature, within a video clip or shot. By utilizing dozens, hundreds or even thousands of such semantic features we can support many kinds of content-based video navigation. Critically however, this depends on being able to determine whether each feature is or is not present in a video clip. The last 5 years have seen much progress in the development of techniques to determine the presence of semantic features within video. This progress can be tracked in the annual TRECVid benchmarking activity where dozens of research groups measure the effectiveness of their techniques on common data and using an open, metrics-based approach. In this chapter we summarise the work done on the TRECVid high-level feature task, showing the progress made year-on-year. This provides a fairly comprehensive statement on where the state-of-the-art is regarding this important task, not just for one research group or for one approach, but across the spectrum. We then use this past and on-going work as a basis for highlighting the trends that are emerging in this area, and the questions which remain to be addressed before we can achieve large-scale, fast and reliable high-level feature detection on video

The GREGOR Fabry-P\'erot Interferometer

The GREGOR Fabry-P\'erot Interferometer (GFPI) is one of three first-light instruments of the German 1.5-meter GREGOR solar telescope at the Observatorio del Teide, Tenerife, Spain. The GFPI uses two tunable etalons in collimated mounting. Thanks to its large-format, high-cadence CCD detectors with sophisticated computer hard- and software it is capable of scanning spectral lines with a cadence that is sufficient to capture the dynamic evolution of the solar atmosphere. The field-of-view (FOV) of 50" x 38" is well suited for quiet Sun and sunspot observations. However, in the vector spectropolarimetric mode the FOV reduces to 25" x 38". The spectral coverage in the spectroscopic mode extends from 530-860 nm with a theoretical spectral resolution R of about 250,000, whereas in the vector spectropolarimetric mode the wavelength range is at present limited to 580-660 nm. The combination of fast narrow-band imaging and post-factum image restoration has the potential for discovery science concerning the dynamic Sun and its magnetic field at spatial scales down to about 50 km on the solar surface.Comment: 14 pages, 17 figures, 4 tables; pre-print of AN 333, p.880-893, 2012 (AN special issue to GREGOR

A retrospective of the GREGOR solar telescope in scientific literature

In this review, we look back upon the literature, which had the GREGOR solar telescope project as its subject including science cases, telescope subsystems, and post-focus instruments. The articles date back to the year 2000, when the initial concepts for a new solar telescope on Tenerife were first presented at scientific meetings. This comprehensive bibliography contains literature until the year 2012, i.e., the final stages of commissioning and science verification. Taking stock of the various publications in peer-reviewed journals and conference proceedings also provides the "historical" context for the reference articles in this special issue of Astronomische Nachrichten/Astronomical Notes.Comment: 6 pages, 2 color figures, this is the pre-peer reviewed version of Denker et al. 2012, Astron. Nachr. 333, 81